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[57] ABSTRACT 

Positions of users other than a particular user in a virtual 
reality space shared by many users can be recognized with 
ease and in a minimum display space. The center (or 
intersection) of a cross of radar map corresponds to the 
particular user and the positions of other users (to be 
specific, the avatars of the other users) around the particular 
user are indicated by dots or squares colored red for example 
in the radar map. This radar map is displayed on virtual 
reality space image in a superimposed manner. 
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3D VIRTUAL REALITY MULTI-USER user's avatar are shown from the viewpoint of a third person, 

INTERACTION WITH SUPERIMPOSED the sense of pseudo experience is marred to a large extent. 

POSITIONAL INFORMATION DISPLAY FOR Therefore, realization of the walk-through capability has 

EACH USER keen awa i tec * by the industry concerned, in which the virtual 

5 space is displayed in three-dimensional graphics and a user 

BACKGROUND OF THE INVENTION can walk freely in the virtual space from the viewpoint of an 

F' m f iU t t* avatar, thus enhancing the sense of pseudo experience. 

1. Meld ot me invention . „ . On the other hand, for a related art example for realizing 
Hie present invention generally relates to an information the sharing of a three-dimensional virtual reality space on a 

processing apparatus, an information processing method, network, a system of FIG. 31 is known which is constituted 

and an information providing medium and, more 10 by client terminals 3-1 through 3-3 interconnected by the 

particularly, to an information processing apparatus, an LAN (Local Area Network) installed in companies or labo- 

information processing method, and an information provid- ratories. 

ing medium for allowing easy recognition of a positional a n c n ent terminals 3-1 through 3-3 read graphics 

relationship between a particular user and another. data that describe the same three-dimensional space to 

2. Description of Related Art 15 display the same three-dimensional space. At this point of 
A cyberspace service named Habitat (trademark) is ^ms, the three-dimensional spaces visually recognized by 

known in the so-called personal computer communications ^ uscrs match each other. 

services such as NIFTY-Serve (trademark) of Japan and Meanwhile, if, at a client terminal 3-1, the user changed 

CompuServe (trademark) of US in which a plurality of users ^ positions of his avatar A from the position indicated by a 

connect their personal computers via modems and public dashed line to the position indicated by a solid line as shown 

telephone network to the host computers installed at the in FIG. 31 for example, information about the change (or 

centers of the services to access them in predetermined change information) is sent from the client terminal 3-1 to 

protocols. Development of Habitat started in 1985 by Lucas client terminals 3-2 and 3-3 via a LAN, not shown. Then, 

Film of the US, operated by Quantum Link, one of US 25 based on the change information from the client terminal 

commercial networks, for about three years. Then, Habitat 3-1, display is changed at the client terminals 3-2 and 3-3. 

started its service in NIFTY-Serve as Fujitsu Habitat Namely, as shown in FIG. 31, the change information 

(trademark) in February 1990. In Habitat, users can send about the positional change of avatar A at the client terminal 

their alter egos called avatars (the incarnation of a god 3-1 (in the example of FIG. 31, "Move Object to (10,20, 

figuring in the Hindu mythology) into a virtual city called 30 30)") is sent to the client terminals 3-2 and 3-3, at which 

Populopolis drawn by two-dimensional graphics to have a display of avatar A is changed from the position indicated by 

chat (namely, a realtime conversation based on text entered dashed line to the position indicated by solid line according 

and displayed) with each other. For further details of to the change information. Thus, avatar A moved at the client 

Habitat, refer to the Japanese translation of "Cyberspace: terminal 3-1 is also moved at the client terminals 3-2 and 

First Steps," Michael Benedikt, ed., 1991, MIT Press 35 3-3. 

Cambridge, Mass., ISBN0-262-O2327-X, the translation Likewise, if a change is made to the virtual reality space 

being published Mar. 20, 1994, by NTT Publishing, ISBN4- at the client terminal 3-2 or 3-3 other than the client terminal 

87188-265-9C0010, pp. 282-307. 3-1, the change is reflected at the other client terminals, thus 

The related art cyberspace system represented by above- allowing the users of all client terminals to share the same 

mentioned Habitat operated in the above-mentioned per- 40 virtual reality space. 

sonal communications services has a multi-user capability in It should be noted that an object representing an avatar, or 

which a plurality of users share the same virtual reality space an later ego of a user, can be moved in the virtual reality 

displayed in two-dimensional graphics via the client termi- space, entered in it, and made exit from it; in other words, 

nals to share the movement and the like of avatars of these the avatar is changed in its states or the states are updated, 

users. 45 So, such an object is appropriately called an update object 

However, the related art multi-user capability is restricted hereinafter. On the other hand, an object representative of a 

to only specified users, not open to unspecified users. building constituting a town in the virtual reality space is 

Namely, taking the above-mentioned Habitat for example, used commonly by a plurality of users and does not change 

users are required first to purchases dedicated personal in its basic state. Even if the building object changes, it 

computer communications software, install the software 50 changes autonomously, namely it changes independent of 

program in their own personal computers (the client the operations made at client terminals. Such an object 

terminals), connected the personal computers to the host commonly used by a plurality of users is appropriately 

computer via the modem and the public telephone network, called a basic object hereinafter. 

and register themselves as members of Habitat by online Meanwhile, FIG. 32 shows an example of display of 
sign-up. only after the registration, they can access the 55 Cyber Gate (trademark), a VRML browser having a multi- 
virtual reality space. Therefore, the virtual reality space is user capability developed by Black Sun Interactive of US. A 
available only to the registered members, excluding the shared virtual reality space is displayed in a main window 
unspecified users. open on the left side of the figure. 

Moreover, in the related art cyberspace system rep re- In this case, if an avatar is displayed in the main window, 

sen ted by Habitat, a virtual street, a virtual room interior, and 60 the user can recognize that another user exists in the same 

the like are drawn in two-dimensional graphics. In such an virtual reality space. However, if another user existing in the 

environment, movement of an avatar backward or forward is same virtual reality space is not near the user or, even if 

realized simply by moving it up or down in a two- another user is near the user, if another user is behind the 

dimensional background, providing poor representation for user or hidden behind some object, the user cannot recognize 

enabling the user to experience walk or movement in the 65 the existence of another user. If this happens, the user must 

virtual space. Because this scheme makes the user look at walk about in the virtual reality space, looking about another 

the virtual space in which the user's avatar and another user. 
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To meet such a requirement, viewers such as mentioned FIG. 11 describes a view field seen from avatar D of FIG. 

above generally have a so-called radar capability. 9; 

In Cyber Gate, a VRML browser, shown in FIG. 32, FIG. 12 describes an allocated space of a part of the 

performing a predetermined operation opens a radar window cyberspace of FIG. 1; 

shown on the right side of the figure, in which a two- 5 FIG. 13 describes a view field seen from avatar C of FIG. 

dimensional image indicating a top view of the virtual 12; 

reality space is displayed. FIG. 14 describes a view field seen from avatar F of FIG. 

Hence, by looking at this radar window, the user can 12; 

recognize the position of another user and move to him ^ ^ 15 [& a flowchart describing operations of the client 

while looking at the display. terminal 13 (the service provider terminal 14) of FIG. 1; 

In the related art technology, however, as shown in FIG. FIG. 16 is a flowchart describing operations of the infor- 
32, the two-dimensional image showing the position of ma tion server terminal 10 of FIG. 1; 
another user is shown in the radar window open at a position . _ . , , ., , Pjl 
different from that of the main window in which the virtual ^ . 17 15 a fl ™*? 1 describing operations of the map- 
reality space is shown. 15 ^ xtWT termmal 12 of ^ 

Consequently, the user must move his line of sight from FIG 18 is a flowchart describing operations of the shared 

the main window to the radar window, check the position of scrvcr tcrmmal 11 01 HCj - ^ 

another user, return the sight line again to the main window, FIG- 19 describes a communication protocol for the 

and perform a predetermined operation such as movement, 20 communication between the client terminal 13, the infor- 

resulting in complicated and cumbersome operations. mation server terminal 10, the shared server terminal 11, and 

the mapping server terminal 12 of FIG. 1; 

SUMMARY OF THE INVENTION FIG 2 o describes the case in which a plurality of shared 

It is therefore an object of the present invention to allow server terminals exist for controlling update objects arranged 

a user to easily recognize the position of another user sharing 25 in ^ same virtual realit y s P ace J 

a three-dimensional virtual reality space. FIG. 21 is a block diagram illustrating another example of 

An information processing apparatus described in claim ^ constitution of the client terminal 13 of FIG. 1; 

1, an information processing method described in claim 8, FIG. 22 describes destinations in which basic objects and 

and an information providing medium described in claim 9 update objects are stored; 

are characterized by displaying positional information asso- 30 FIG. 23 describes an arrangement of basic objects and 

ciated with the position of an update object existing in a update objects; 

three-dimensional virtual reality space by superimposing the pjQ 2 4 describes software for implementing the cyber- 

positional information on a three-dimensional virtual reality space svstem 0 f pjQ 

un ^ & ' m 35 FIG. 25 describes software operating on the client termi- 

Tbe information providing medium herein denotes not nal ^ of FIG x and tfae shared iermin2Ll n . x of 

only package media such as a floppy disk and a CD-ROM ^. 

in which computer programs are stored but also a transmis- * ' „ , , >t _ . , , , t , A 

A . f u- u , ■ FIG. 26 describes an environment in which the software 

sion medium by which a computer program is downloaded 

via a network such as the Internet for example. 01 MU * 25 °P erates i 

The above and other objects, features and advantages of 40 FIGS ^ 27A f and 27B s ^ w a c ^ ro1 ^ a 

the present invention will become more apparent from the ™ nds ^formation table controlled by Bureau (the 

accompanying drawings, in which like reference numerals snared server termmal n )i 

are used to identify the same or similar parts in several FIG. 28 shows an aura (a visible area and a chat enable 

v j ews area) in a shared virtual reality space controlled by Bureau 

45 (the shared server terminal 11); 

BRIEF DESCRIPTION OF THE DRAWINGS FIG. 29 is a photograph illustrating a display example of 

FIG. 1 is a block diagram illustrating a cyberspace system a screen in a browser operating on the client terminal 13; 

practiced as one preferred embodiment of the invention; FIG. 30 shows a radar map 203; 

FIG. 2 describes WWW (World Wide Web); 50 FIG. 31 is a schematic diagram illustrating a cyber system 

FIG. 3 is a diagram illustrating an example of a URL built via a related-art LAN; and 

(Uniform Resource Locator); FIG. 32 is a photograph illustrating a display example of 

FIG. 4 is a block diagram illustrating an example of the a screen in a related- art VRML browser, 
constitution of an information server terminal 10 of FIG. 1; 

FIG. 5 is a block diagram illustrating an example of the 55 DETAILED DESCRIPTION OF PREFERRED 

constitution of a shared server terminal 11 of FIG. 1; EMBODIMENTS 

FIG. 6 is a block diagram illustrating an example of the This invention will be described in further detail by way 

constitution of a mapping server terminal 12 of FIG. 1; 0 f example with reference to the accompanying drawings. 

FIG. 7 is a block diagram illustrating an example of the 6Q The basic idea and concept of a virtual society is 

constitution of a client terminal 13 of FIG. 1; described by Hiroaki Kitano, Sony Computer Science 

FIG. 8 is a block diagram illustrating an example of the Laboratories, as follows in his home page "Kitano Hiroaki 

constitution of a server provider terminal 14 of FIG. 1; Virtual Society (VI .0) (http://www.csl^onyxo.jp/person/ 

FIG. 9 describes a virtual reality space formed by the kitanoA ^ S/concept.j.html.l995) ,, : 

cyberspace system of FIG. 1; 65 "In the beginning of the 21st century, a virtual society 

FIG. 10 describes a view field seen from avatar C of FIG. would emerge in a network spanning all the world. People 

9; in every part of the world will make a society in which 
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millions or hundred millions of people live in a shared space WWW, set hyper text links to objects drawn by three- 
created in the network. Asociety that will emerge beyond the dimensional graphics, and follow these links to sequentially 
current Internet, CATV, and the so-called information super access WWW server terminals. The specifications of VRML 
highway is a virtual society that I conceive. In the virtual version 1.0 were made public in May 26, 1995. Then, in 
society, people can not only perform generally the same 5 Nov. 9, 1995, a revised version in which errors and ambigu- 
social activities as those in the real world, enjoy shopping, ous expressions are corrected was made public. The speci- 
have a chat, play games, do work, and the like, but also fications are available from URL=http://www. vrml.org/ 
perform things that are possible only in the virtual society Srxcifications/VRMLl .0/. 

(for example, moving from Tokyo to Paris in an instant). Storing three-dimensional information described in the 

Such a "society" would be implemented only by state-of- 10 above-mentioned VRML in a WWW server terminal allows 

the-art technologies such as cyberspace constructing tech- the construction of a virtual space expressed in three- 

nologies that support a broadband network, high-quality dimensional graphics on the Internet. Further, use of the 

three-dimensional presentation capability and bidirectional VRML viewer by using personal computers and the like 

communications of voice, music and moving picture signals, interconnected by the Internet can implement the display of 

and a large-scale distributed system that allows a lot of 15 a virtual space based on three-dimensional graphics and the 

people to share the constructed space." walk-through capability. 

For farther details, look at the above mentioned home i a wnat follows, examples in which the Internet is used 

page. for a network will be described. It will be apparent to those 

The three-dimensional virtual reality space that imple- skilled in the art that FTTH may be used instead of the 
ments the above-mentioned virtual society is a cyberspace 20 Internet to implement the virtual space, 
system. The actual examples of the infrastructures for con- [ t should be noted that Cyberspace is a coinage by 
structing this cyberspace system includes, at this point of William Gibson, a US science fiction writer, and was used 
time, the Internet, which is a world-wide computer network m his "Neuromancer" (1984), a book depicting the latter half 
connected by a communications protocol called TCP/IP of the 21st century, that made him famous. Strictly speaking, 
(Transmission Control Protocol/Internet Protocol) and the 25 however, the word Cyberspace first appeared in his "Bum- 
intranet implemented by applying the Internet technologies mg Cb r0 me" (1982). In these novels, there are scenes in 
such as WWW (World Wide Web) to the in-house LAN wmcn the hero attaches a special electrode on his forehead 
(Local Area Network). Furt her, u se of a broadband commu- to connect himself to a computer to directly reflect on his 
nication network based on FTTH (Fiber To The Home) in brain a virtual three-dimensional space obtained by visually 
the future is proposed in which the main line system and the 30 reconfiguring data on a computer network spanning all over 
subscriber system are all constituted by fiber optics. me WO rld. This virtual three-dimensional space was called 

Meanwhile, for an information providing system avail- Cyberspace. Recently, the term has come to be used as 

able on the Internet, WWW developed by CERN (European denoting a system in which a virtual three-dimensional 

Center for Nuclear Research) in Switzerland is known. This ^ space is used by a plurality of users via a network. In this 

technology allows a user to browse information including embodiment, the term "Cyberspace" is used as having the 

text, image and voice for example in the hyper text form. above meaning. 

Based on HTTP (Hyper Text Transfer Protocol), the infer- Now, referring to FIG. 1, there is shown an example of a 

mation stored in a WWW server terminal is sent asynchro- constitution of a cyberspace (a three-dimensional virtual 

nously to terminals such as personal computers. ^ reality space provided via a network) system according to 

The WWW server is constituted by server software called the present invention. As shown, in this preferred 

an HTTP demon and an HTML file in which hyper text embodiment, host computers (or simply hosts) A through C, 

information is stored. The hyper text information is a plurality (three in this case) of client terminals 13-1 

described in a description language called HTML (Hyper through 13-3, and any number (one in this case) of service 

Text Makeup Language). In the description of a hyper text 45 provider terminal 14 are interconnected via a world-wide 

by HTML, a logical structure of a document is expressed in network 15 (a global communication network sometimes 

a format specification called a tag enclosed by "<" and ">". referred to as an information transmission medium herein) 

Description of linking to other information is made based in like the Internet 15 by way of example, 

link information called an anchor. A method in which a xhe host A constitutes a system of so-called WWW 

location at which required information is stored by the 5Q (World Wide Web) for example. Namely, the host A has 

anchor is URL (Uniform Resource Locator). information (or a file) to be described later. And, each piece 

A protocol for transferring a file described in HTML on of information (or each file) is related with a URL (Uniform 

the TCP/IP network is HTTP. This protocol has a capability Resource Locator) for uniformly specify that information, 

of transferring a request for information from a client to the Specifying a URL allows access to the information corre- 

WWW server and the requested hyper text information 55 sponding to it. 

stored in the HTML file to the client. j 0 be more specific, the host A stores three-dimensional 

Used by many as an environment for using WWW is image data for providing three-dimensional virtual reality 

client software such as Netscape Navigator (trademark) spaces (hereinafter appropriately referred to simply as vir- 

called a WWW browser. tual reality spaces) such as virtual streets in Tokyo, New 

It should be noted that demon denotes a program for 60 York, and other locations for example. It should be noted 

executing control and processing in the background when that these three-dimensional image data do not change in 

performing a job in the UNIX environment. their basic state; that is, these data include static data 

Recently, a language for describing three-dimensional consisting of only basic objects such as a building and a road 

graphics data, called VRML (Virtual Reality Modeling to be shared by a plurality of users. If the basic state changes, 

Language) and a VRML viewer for drawing a virtual reality 65 it only reflects an autonomous change in the state of a 

space described in this VRML on a personal computer or a merry-go-round or a neon. The static data are considered to 

workstation have been developed. WML allows to extend be data that are not subject to update. The host A has an 



04/26/2004, EAST Version: 1.4.1 



6,057,856 

7 8 

information server terminal 10 (a basic server terminal). The information that can be provided in this system include not 

information server terminal 10 is adapted, when it receives only texts but also graphics, images (including still images 

a URL via the network 15, to provide the information and moving pictures), voices, three-dimensional images, and 

corresponding to the received URL, namely a corresponding hyper texts which combines all these information, 

virtual reality space (in this case, a space consisting of only S [ n WWW, a URL, or a form for uniformly represent these 

basic objects). pieces of information is determined. Specifying a specific 

It should be noted that, in FIG. 1, there is only one host, URL, each user can obtain the information corresponding to 

namely the host A, which has an information server terminal the specified URL. As shown in FIG. 3, each URL is 

for providing the virtual reality space (consisting of only composed of a protocol type for representing a service type 

basic objects) of a specific area. It is apparent that such a io (http in the preferred embodiment of FIG. 3, which is 

host may be installed in plural. equivalent to a command for retrieving a file corresponding 

The host B has a shared server terminal 11. The shared to a file name to be described later and send the retrieved 

server terminal 11 controls update objects that constitute a file), a host name indicating a destination of the URL (in the 

virtual reality space when put in it. The update objects are embodiment of FIG. 3, www.csl.sony.co. jp), and a file name 

avatars for example representing users of the client termi- 15 of data to be sent (in the embodiment of FIG, 3, index.html) 

nals. Thus, the shared server terminal 11 allows a plurality for example. 

of users to share the same virtual reality space. It should be Each user operates the client terminal to enter a URL for 

noted, however, that the host B controls only the update desired information. When the URL is entered, the client 

objects located in a virtual reality space for only a specific terminal references a host name, for example, contained in 

area (for example, Tokyo) of the virtual reality spaces 20 the URL. A link with a host (in the embodiment of FIG. 2, 

controlled by the host A. That is, the host B is dedicated to the host x for example connected to the Internet) addressed 

the virtual reality space of a specific area. Also, it should be by the host name is established. Then, at the client terminal, 

noted that the network 15 is connected with, in addition to the URL is sent to the linked host, namely the host X, via the 

the host B, a host, not shown, having a shared server Internet, requesting the host X for sending the information 

terminal for controlling update objects located in virtual 25 specified in the URL. In the host X, an HTTP demon (httpd) 

reality spaces of other areas such as New York and London, is operating on the information server terminal (the WWW 

stored in the host A. server terminal). Receiving the URL> the information server 

The host C, like the host A, constitutes a WWW system terminal sends back the information specified in the URL to 

for example and stores data including IP (Internet Protocol) ^ the client terminal via the Internet. 

addresses for addressing hosts (shared server terminals) that The client terminal receives the information from the 

control update objects like the host B. Therefore, the shared information server terminal to display the received informa- 

server terminal addresses stored in the host C are uniformly tion on its monitor as required. Thus, the user can get the 

related with URLs as with the case of the host A as desired information. 

mentioned above. In addition, the host C has a mapping ^ Therefore, only storing in the host such data for describ- 

server terminal 12 (a control server terminal). Receiving a hig elements (objects) for constituting a virtual reality space 

URL via the network 15, the mapping server terminal 12 as shapes of basic objects (for example, a rectangular prism 

provides the IP address of the shared server terminal corre- ^ a cone ) an( j locations and attributes (color and texture 

sponding to the received URL via the network 15. It should f or example) of these basic objects allows to provide the 

be noted that FIG. 1 shows only one host, namely the host virtual reality space (consisting of only basic objects in this 

C, which has the mapping server terminal 12 for providing case ) to unspecified users. Namely, as long as the Internet is 

shared server terminal addresses. It will be apparent that the use( j f or the network 15 and WWW is used, virtual reality 

host C can be installed in plural. spaces can be provided to unspecified users world-wide with 

The client terminal 13 (13-1, 13-2 or 13-3) receives a ease and at a low cost because the Internet itself already 

virtual reality space from the information server terminal 10 45 spans almost all over the world and the description of the 

via the network 15 to share the received virtual reality space elements constituting each virtual reality space to be stored 

with other client terminals (including the service provider in hosts does not require to make changes to information 

terminal 14), under the control of the shared server terminal servers (WWW server terminals) constituting WWW. It 

11. Further, the client terminal 13 is also adapted to receive should be noted that the service for providing the description 

specific services (information) using the virtual reality space 50 of the elements constituting a virtual reality space is upward 

from the service provider terminal 14. compatible with existing services provided by WWW. 

The service provider terminal 14, like the client terminal Storing in a specific host (a mapping server terminal) the 

13, receives a virtual reality space to share the same with the IP addresses of other hosts as information also allows to 

client terminal 13 (if there is another service provider provide the host IP addresses to unspecified users world - 

terminal, it also shares this space). Therefore, as far as the 5S wide with ease. 

capability of this portion is concerned, the service provider \ { should be noted that it is difficult for a plurality of users 

terminal 14 is the same as the client terminal 13. l0 sna re the same virtual reality space if only the description 

Further, the service provider terminal 14 is adapted to (the data of three-dimensional image for providing the 

provide specific services to the client terminal 13. It should virtual reality space of a specific area) of elements consti- 

be noted that FIG. 1 shows only one service provider 60 tuting the virtual reality space is stored in a host constituting 

terminal 14. It will be apparent that the service provider WWW. Namely, in WWW, the information corresponding to 

terminal may be installed in plural. a URL is only provided to a user and therefore no control for 

The following briefly describes a WWW system consti- information transfer is performed. Hence, it is difficult to 

tuted by the host A and the host C. Referring to FIG. 2, transfer between users the above-mentioned change infor- 

WWW is one of the systems for providing information from 65 mation of update objects by using WWW without changing 

hosts X, Y, and Z to unspecified users (client terminals) via its design. Therefore, in the cyberspace system of FIG. 1, the 

the network 15 (the Internet in the case of WWW). The host B having the shared server terminal 11 and the host C 
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having the mapping server 12 are installed to allow a 
plurality of users to share the same virtual reality space, 
details of which will be described later. 

Next, FIG. 4 shows an example of the constitution of the 
information server terminal 10 that operates on the host A of 5 
FIG. 1. As shown in FIG. 4, the information server terminal 
10 has a CPU 81 which performs a variety of processing 
operations according to a program stored ia a ROM 82. Id 
the information server 10, the above-mentioned HTTP 
demon is operating in the background. A RAM 83 stores 10 
data and program necessary for the CPU 81 to perform the 
variety of processing operations. A communication device 
84 is adapted to transfer specific data with the network 15. 
A storage device 85 composed of a hard disc, an optical disc, 
and magneto-optical disc stores the data of the three- 15 
dimensional images for providing a virtual reality space of 
a specific area such as Tokyo or New York for example along 
with URLs as mentioned above. 

FIG. 5 shows an example of the constitution of the shared 
server terminal 11 operating on the host B of FIG. 1. As 20 
shown, the shared server terminal 11 has a CPU 21 which 
executes a variety of processing operations according to a 
program stored in a ROM 22. A RAM 23 appropriately 
stores data and a program necessary for the CPU 21 to 
execute the variety of processing operations. A communi- 25 
cation device 24 transfers specific data with the network 15. 

A display device 25 has a CRT (Cathode Ray T\ibe) or an 
LCD (Liquid Crystal Display) for example and is connected 
to interface 28 to monitor images of the virtual reality space 3q 
(composed of not only basic objects but also update objects) 
of an area controlled by the shared server terminal 11. The 
interface 28 is also connected with a microphone 26 and a 
loudspeaker 27 to supply a specific voice signal to the client 
terminal 13 and the service provider terminal 14 and monitor ^ 
a voice signal coming from these terminals. 

The shared server terminal 11 has an input device 29 on 
which a variety of input operations are performed via the 
interface 28. This input device 29 has at least a keyboard 29a 
and a mouse 29b. 40 

A storage device 30 composed of a hard disc, an optical 
disc, and a magneto-optical disc stores data of the virtual 
reality space of an area controlled by the shared server 
terminal 11. It should be noted that the data of the virtual 
reality space are the same as those stored in the storage 45 
device 85 of the information server terminal 10 (of FIG. 4). 
When these data are displayed on the display device 25, the 
virtual reality space of the area controlled by the shared 
server terminal 11 is displayed. 

FIG. 6 shows an example of the constitution of the 50 
mapping server terminal 12 operating on the host C of FIG. 
1. Components CPU 91 through communication device 94 
are generally the same in constitution as those of FIG. 4, so 
that the description of the components of FIG. 6 is omitted 
in general. A storage device 95 stores addresses, along with 55 
URLs, for identifying shared server terminals that control 
update objects (in the embodiment of FIG. 1, only the shared 
server terminal 11 is shown; actually, other shared server 
terminals, not shown, are connected to the network 15). 

FIG. 7 shows an example of the constitution of the client 60 
terminal 13 (actually, client terminals 13-1 through 13-3). 
The client terminal 13 has a CPU 41 which executes a 
variety of processing operations according to a program 
stored in a ROM 42. A RAM 43 appropriately stores data 
and a program necessary for the CPU 41 to executes the 65 
variety of processing operations. A communication device 
44 transfers data via the network 15. 
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A display device 45 has a CRT or an LCD to display 
three-dimensional images created by computer graphics or 
taken by an ordinary video camera. A microphone 46 is used 
to output a voice signal to the shared server terminal 11. A 
loudspeaker 47 outputs the voice signal coming from the 
shared server terminal 11. An input device 49 is operated to 
perform a variety of input operations. 

A keyboard 49a of the input device 49 is operated when 
entering text (including an URL) composed of specific 
characters and symbols. A mouse 49b is operated when 
entering specific positional information. A viewpoint input 
device 49c and a movement input device 49d are operated 
when changing the state of the avatar as an update object of 
the client terminal 13. That is, the viewpoint input device 
49c is used to enter the viewpoint of the avatar of the client 
terminal 13, thereby moving the viewpoint of the avatar 
vertically, horizontally or in the depth direction. The move- 
ment input device is used to move the avatar in the forward 
and backward direction or the right and left direction at a 
specific velocity. It is apparent that the operations done 
through the viewpoint and movement input devices may also 
be done through the above-mentioned keyboard 49a and the 
mouse 49b. 

A storage device 50 composed of a hard disc, an optical 
disc, and magneto-optical disc stores avatars (update 
objects) representing users. Further, the storage device 50 
stores a URL (hereinafter appropriately referred to as an 
address acquisition URL) for acquiring an IP address of a 
shared server terminal for managing update objects to be 
located in the virtual reality space of each area stored in the 
information server terminal 10 (if there is an information 
server terminal other than the information server terminal 
10, that information server terminal is included). The 
address acquisition URL is stored as associated with a URL 
(hereinafter appropriately referred to as a virtual reality 
space URL) corresponding to the data of the virtual reality 
space of that area. This setup allows to obtain the address 
acquisition URL for acquiring the IP address of the shared 
server terminal for controlling the virtual reality space of 
that area when the virtual reality space URL for the data of 
the virtual reality space for that area has been entered. 

Interface 48 constitutes the data interface with a display 
device 45, a microphone 46, a loudspeaker 47, an input 
device 49, and the storage device 50. 

FIG. 8 shows an example of the constitution of the service 
provider terminal 14 of FIG. 1. The components including a 
CPU 51 through a storage device 60 are generally the same 
as the components including the CPU 41 through the storage 
device 50 and therefore the description of the CPU 51 
through the storage device 60 is omitted. 

FIG. 9 shows schematically a virtual reality space that is 
provided by the information server terminal 10 of FIG. 1 and 
can be shared by a plurality of users under the control of the 
shared server terminal 11. As shown in FIG. 9, this virtual 
reality space constitutes a town, in which avatar C (avatar of 
the client terminal 13-1 for example) and avatar D (avatar of 
the client terminal 13-2 for example) can move around. 

Avatar C sees an image as shown in FIG. 10 for example 
from the position and viewpoint in the virtual reality space. 
Namely, data associated with the basic objects constituting 
the virtual reality space are provided to the client terminal 
13-1 from the information server terminal 10 to be stored in 
a RAM 43 (or a storage device 50). Then, from the RAM 43 
(or the storage device 50), data are read out of a virtual 
reality space that can be seen when the same is seen from 
specific viewpoint and position and the read data are sup- 
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plied to the display device 45. Then, when the viewpoint and is displayed on the display device 45 of the client terminal 

position of avatar C are changed by operating a viewpoint 13-1, in correspondence to the position and viewpoint of 

input device 49c and a movement input device 49d, data avatar C. If avatar F is located behind the service counter 71, 

corresponding the change are read from the RAM 43 (or the an image as shown in FIG. 14 is displayed on a display 

storage device 50) to be supplied to the display device 45, 5 device 55 of the service provider terminal 14. As shown in 

thereby changing the virtual reality space (the three- FIGS. 13 and 14, the image viewed from avatar C shows 

dimensional image) being displayed on the display device avatar F, while the image viewed from avatar F shows avatar 

45. C. 

Further, data associated with another user's avatar (an As shown in FIG. 13, the image viewed from avatar C 

update object) (avatar D of FIG. 10) that can be seen when 10 shows a cursor 74 to be used when a specific image is 

the virtual reality space is seen from the current viewpoint specified from the client terminal 13-1. Likewise, as shown 

and position are supplied to the client terminal 13-1 from the in FIG. 14, a cursor 75 is shown for the service provider 

shared server terminal 11. Based on the supplied data, the terminal 14 to specify a specific image, 

display on the display device 45 is changed. Namely, in the Moving avatar C around the television 72 or 73 by 

state of FIG. 9, since avatar C is looking in the direction of is operating the movement input device 49d of the client 

avatar D, avatar D is displayed in the image (the virtual terminal 13-1 displays on the display device 45 the image 

reality space) displayed on the display device 45 of the client corresponding to avatar Cs moved position and viewpoint, 

terminal 13-1 as shown in FIG. 10, This allows the user to take a close look at the televisions as 

Likewise, an image as shown in FIG. 11 is displayed on if they were exhibited in a shop of the real world, 

the display device 45 of the client terminal 13-2 to which 20 Also, when the user moves the cursor 74 by operating a 

avatar D corresponds. This displayed image is also changed mouse 49b and then click on avatar F, a conversation request 

by moving the viewpoint and position of avatar D. It should signal is transmitted to the service provider terminal 14 

be noted that, in FIG. 9, avatar D is looking in the direction corresponding to avatar F. Receiving the conversation 

of avatar C, so that avatar C is displayed in the image (the request signal, the service provider terminal 14 can output, 

virtual reality space) on the display device 45 of the client 25 via a microphone 56, a voice signal to a loudspeaker 47 of 

terminal 13-2 as shown in FIG. 11. the client terminal 13-1 corresponding to avatar C. Likewise, 

The service provider terminal 14 controls a part of the entering a specific voice signal from a microphone 46 of the 

sharable virtual reality space provided by the information client terminal 13-1 can transmit user's voice signal to a 

server terminal 10 and the shared server terminal 11. In other speaker 57 of the service provider terminal 14. Thus, the 

words, the service provider purchases a part of the virtual 30 user and service provider can make conversation in a usual 

reality space from administrators (information providers manner. 

who provide information of the virtual reality space) of the [t is apparent that the conversation can be requested from 

information server terminal 10 and the shared terminal 11. avatar F (the service provider terminal 14) to avatar C (the 

This purchase is performed in the real space. Namely, upon ^ client terminal 13-1). 

request by a specific service provider for the purchase of the When the cursor 74 is moved on the client terminal 13-1 

virtual reality space, the administrators of the information ^ the image of the television 72 for example is clicked, the 

server terminal 10 and the shared server terminal 11 allocate information (the provided information) describing the tele- 

a part of the requested virtual reality space to that specific vision 72 is provided in more detail. This can be imple- 

service provider. 4Q me nted by linking the data of the virtual reality space 

For example, assume that the owner (service provider) of provided by the information server terminal 10 with the 

the service provider terminal 14 lease a room in a specific description information about the television. It is apparent 

building in the virtual reality space and use the room as a that the image for displaying the description information 

shop for electric appliances. The service provider provides may be either three-dimensional or two-dimensional, 

information about commodities, for example televisions, to 45 The specification of desired images can be performed also 

be sold in the shop. Based on the information, the server from the service provider terminal 14. This capability allows 

terminal administrator creates three-dimensional images of the service provider to offer the description information to 

the televisions by computer graphics and place the created the user in a more active manner. 

images at specific positions in the shop. Thus, the images to [f tne service provider specifies avatar C with the cursor 

be placed in the virtual reality space have been completed. 5Q 75 by operating the mouse 596, the image corresponding to 

Similar operations are performed by other service pro- the position and viewpoint of avatar C, namely, the same 

viders to form the virtual reality space as a big town for image as displayed on the display device 45 of the client 

example. terminal 13-1 can be displayed on the display device 55 of 

FIG. 12 is a top view of a virtual reality space (a room in the service provider terminal 14. This allows the service 

a building in this example) to be occupied by the service 55 provider to know where the user (namely avatar C) is 

provider owning the service provider terminal 14. In this looking at and therefore promptly offer information needed 

embodiment, one room of the building is allocated to this by the user. 

service provider in which two televisions 72 and 73 are The user gets explanations about the products, or gets the 

arranged with a service counter 71 placed at a position provided information or description information. If the user 

shown. The service provider of the service provider terminal 60 wants to buy the television 72 for example, he can buy the 

14 places his own avatar F behind the service counter 71. It same actually. In this case, the user requests the service 

will be apparent that the service provider can move avatar F provider terminal 14 for the purchase via avatar F. At the 

to any desired position by operating a movement input same time, the user transmits his credit card number for 

device S9d of the service provider terminal 14. example to the service provider terminal 14 (avatar F) via 

Now, assume that avatar C of the client terminal 13-1 has 65 avatar C. Then, the user asks the service provider terminal 

come in this electric appliances shop as shown in FIG. 12. for drawing an amount equivalent to the price of the tele- 

At this moment, an image as shown in FIG. 13 for example vision purchased. The service provider of the service pro- 
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vider terminal 14 performs processing for the drawing based 12, the IP address of the shared server terminal correspond- 
on the credit card number and make preparations for the ing to the URL is transmitted to the client terminal 13 via the 
delivery of the purchased product. network 15 in step S32 of FIG. 17 to be described. Thus, in 
The images provided in the above-mentioned virtual step S3, the IP address of the shared server terminal 12 
reality space are basically precision images created by * transmitted from the mapping server 12 is received, 
computer graphics. Therefore, looking at these images from As described above, the address acquisition URL related 
every angle allows the user to make observation of products to the entered virtual reality space URL corresponds to the 
almost equivalent to the observation in the real world, IP address of the shared server terminal that controls the 
thereby providing surer confirmation of products. update object placed in the virtual reality space correspond- 
Thus, the virtual reality space contains a lot of shops, 30 ing to that virtual reality space URL. Therefore, for example, 
movie houses and theaters for example. Because products if the entered virtual reality space URL corresponds to a 
can be actually purchased in the shops, spaces installed at virtual reality space of Tokyo and the shared server terminal 
favorable locations create actual economic values. 11 owned by the host B controls the update objects placed 
Therefore, such favorable spaces themselves can be actually in the Tokyo virtual reality space, the IP address of the 
(namely, in the real world) purchased or leased. This pro- 15 shared server terminal 11 is received in step S3, 
vides complete distinction from the so-called television Consequently, the user can automatically get the location 
shopping system ordinarily practiced. (the IP address) of the shared server terminal that controls 
The following describes the operations of the client the virtual reality space of a desired area even if the user 
terminal 13 (or the service provider terminal 14), the infor- does not know which shared server terminal controls the 
mation server terminal 10, the mapping server terminal 12, 20 Relate objects in a virtual reality space in which area, 
and the shared server terminal 11 with reference to the It should be noted that, in steps S2 and S3, the processing 
flowcharts of FIGS. 15 through 18. of transmitting the virtual reality space URL and the address 
Now, referring to FIG. 15, there is shown an example of acquisition URL and receiving the virtual reality space data 
processing by the client terminal 13 (or the service provider and the IP address is actually performed by transmitting the 
terminal 14). In step SI, the CPU 41 checks whether a virtual realit y s P ace URL > receiving the data of the corre- 
virtual reality space URL has been entered or not. If no sponding virtual reality space, transmitting the address 
virtual reality space URL has been found, the processing acquisition URL, and then receiving the corresponding IP 
remains in step SI. If a virtual reality space URL has been address in this order by way of example, 
found in step SI, namely, if a virtual reality space URL 3Q When the virtual reality space data and the shared server 
corresponding to a desired virtual reality space entered by terminal IP address are received in step S3, the process goes 
the user by operating the keyboard 49a has been received by to step S4. In step S4, a connection request is transmitted 
the CPU 41 via interface 48, the process goes to step S2. In from the communication device 44 via the network 15 to the 
step S2, a WWW system is constituted as described with shared server terminal (in this case, the shared server ter- 
reference to FIG. 2 and the virtual reality space URL is 35 minal U for example) corresponding to the IP address (the 
transmitted from the communication device 44 via the shared server terminal IP address) received in step S3. This 
network 15 to the information server terminal of a specific establishes a link between the client terminal 13 and the 
host (in this case, the information server terminal 10 of the shared server terminal 11. Further, in step S3, after the 
host A for example) that has the information server terminal, establishment of the link, the avatar (namely, the update 
thereby establishing a link. 4Q object) representing oneself stored in the storage device 50 
Further, in step S2, an address acquisition URL related to is transmitted from the communication device 44 to the 
the virtual reality space URL is read from the storage device shared server terminal 11. 

50 to be transmitted from the communication device 44 via When the shared server terminal 11 receives the user's 

the network 15 to the mapping server terminal of a specific avatar, the same is then transmitted to the client terminals of 

host (in this case, mapping server terminal 12 of the host C 45 other users existing in the same virtual reality space (in this 

for example) that constitutes the WWW system, thereby case, that of Tokyo as mentioned above). Then, on the client 

establishing a link. terminals of other users, the transmitted avatar is placed in 

Then, the process goes to step S3. In step S3, data the virtual reality space, thus implementing the sharing of 

(three-dimensional image data) of the virtual reality space or the same virtual reality space among a plurality of users, 

the IP address of the shared server terminal 12 correspond- 50 It should be noted that, rather than providing the user's 

ing to the virtual reality space URL received in step S2 or the avatar from the client terminal 11 to the shared server 

address acquisition URL is received by the communication terminal 11, a predetermined avatar may also be allocated 

device 44. from the shared server terminal 11 to each user who accessed 

Namely, in step S2, the virtual reality space URL is the same. Also, in the client terminal 13, the avatar of the 

transmitted to the information server terminal 10. When this 55 user himself who uses this terminal can be placed and 

virtual reality space URL is received by the information displayed in the virtual reality space however, the user 

server terminal 10, the data of the corresponding virtual cannot see himself in the real world, so that it is desirable for 

reality space are transmitted to the client terminal 13 via the the user's avatar not be displayed on that user's client 

network 15 in step S22 of FIG. 16 to be described. Thus, in terminal in order to make the virtual reality space as real as 

step S3, the data of the virtual reality space transmitted from 60 possible. 

the information server terminal 10 are received. It should be When the processing of step S4 has been completed, the 

noted that the received virtual reality space data are trans- process goes to step S5. In step S5, the data of the virtual 

ferred to the RAM 43 to be stored there (or first stored in the reality space that can be seen when the same is seen from 

storage device 50 to be transferred to the RAM 43). specific viewpoint and position are read from the RAM 43 

Also, in step S2, the address acquisition URL is trans- 65 by the CPU 41 to be supplied to the display device 45. Thus, 

mitted to the mapping server terminal 12. When the address the specific virtual reality space is shown on the display 

acquisition URL is received by the mapping server terminal device 45. 
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llien, in step S6, the communication device 44 deter- viewpoint input device 49c and the movement input device 

mines whether update information of another user's avatar 49d is displayed on the display device 45. 

has been sent from the shared server terminal 11. Further, in step S10, the CPU 41 controls the communi- 

As described above, the user can update the position or cation device 44 to transmit the viewpoint data or the 

viewpoint of his own avatar by operating the viewpoint 5 positional data entered from the viewpoint input device 49c 

input device 49c or the movement input device 49d. If the or the movement input device 49d to the shared server 

update of the position or viewpoint of the avatar is instructed terminal 11, upon which process goes to step Sll. 

by using this capability, the CPU 41 receives the instruction Here, as described above, the update information coming 

via the interface 48. According to the instruction, the CPU from the client terminal 13 is received by the shared server 

41 performs processing for outputting positional data or 10 terminal 11 to be outputted to other client terminals. Thus, 

viewpoint data corresponding to the updated position or the avatar of the user of the client terminal 13 is displayed 

viewpoint as update information to the shared server termi- on the other client terminals. 

nal 11. In other words, the CPU 41 controls the communi- 0 n the other hand, in step S8, if CPU 41 determines that 

cation device 44 to transmit the update information to the tne avatar's position or viewpoint has not been updated, the 

shared server terminal 11. ^ process goes to step Sll by skipping steps S9 and S10. In 

Receiving the update information from the client step Sll, the CPU 41 determines whether the end of the 

terminal, the shared server terminal 11 outputs the update update data input operation has been instructed by operating 

information to other client terminals in step S44 of FIG. 18 a predetermined key on the keyboard; if the end has not been 

to be described. It should be noted the shared server terminal instructed, the process goes back to step S6 to repeat the 

11 is adapted to transmit the avatar received from the client 20 processing. 

terminal that requested for access to client terminals of other Referring to the flowchart of FIG. 16, there is shown an 

users, this avatar being transmitted also as update informa- example of the processing by the information server termi- 

tion. nal 10. First, the communication device 84 determines in 

When the update information has come as mentioned ^ stepS21, whether a virtual reality space URL has come from 

above, it is determined in step S6 that update information of the client terminal 13 via the network 15. If, in step S21, the . 

the avatar of another user has come from the shared server communication device 84 determines that no virtual reality 

terminal 11. In this case, this update information is received space URL has come, the process goes back to step S21. If 

by the communication device 44 to be outputted to the CPU the virtual reality space URL has come, the same is received 

41. The CPU 41 updates the display on the display device 45 3Q by the communication device 84, upon which the process 

according to the update information in step S7. That is, if the goes to step S22. In step S22, the data of the virtual reality 

CPU 41 receives the positional data or viewpoint data from space related to the virtual reality space URL received by the 

another client terminal as update information, the CPU 41 communication device 84 are read by the CPU 81 to be 

moves or changes (for example, the orientation of the avatar) transmitted via the network 15 to the client terminal 13 that 

the avatar of that user according to the received positional 3S transmitted the virtual reality space URL. Then, the process 

data or viewpoint data. In addition, if the CPU 41 receives goes back to step S21 to repeat the above-mentioned pro- 

the avatar from another client terminal, the CPU 41 places cessing. 

the received avatar in the currently displayed virtual reality pic. 17 shows an example of the processing by the 

space at a specific position on the display device 45. It mapping server terminal 12. In the mapping server terminal 

should be noted that, when the shared server terminal 11 4Q 12, the communication device 94 determines in step S31, 

transmits an avatar as update information, the shared server whether an address acquisition URL has come from the 

terminal also transmits the positional data and viewpoint client terminal 13 via the network 15. If no address acqui- 

data of the avatar along with the update information. The sition URL has come, the process goes back to step S3L If 

avatar is displayed on the display device 45 according to the address acquisition URL has come, the same is received 

these positional data and viewpoint data. 45 by the communication device 94, upon which the process 

When the above-mentioned processing has come to an goes to step 32. In step S32, the IP address (the IP address 

end, the process goes to step S8. of the shared server terminal) related to the address acqui- 

Meanwhile, if, in step S6, no update information of the sition URL received by the communication device 94 is read 

avatar of another user has come from the shared server from the storage device 95 by the CPU 91 to be transmitted 

terminal 11, the process goes to step S8, skipping step S7. In 50 via the network 15 to the client terminal 13 that transmitted 

step S8, the CPU 41 determines whether the position or the address acquisition URL. Then, the process goes back to 

viewpoint of the avatar of the user of the client terminal 13 step S31 to repeat the above-mentioned processing, 

has been updated or not by operating the viewpoint input FIG. 18 shows an example of the processing by the shared 

device 49c or the movement input device 49d. server terminal 11. In the shared server terminal 11, the 

In step S8, if the CPU 41 determines that the avatar 55 communication device 24 determines, in step S41, whether 

position or viewpoint has been updated, namely, if the a connection request has come from the client terminal 13 

viewpoint input device 49c or the movement input device via the network 15. If no connection request has come, the 

49rf has been operated by the user, the process goes to step process goes to step S43 by skipping step S42. If the 

S9. In step S9, the CPU 41 reads from the RAM 43 data of connection request has come, that is, if the client terminal 13 

the virtual reality space corresponding to the position and 60 has the connection request to the shared server terminal 11 

viewpoint of the avatar of the user based on the entered in step S4 of FIG. 15, the communication link with the client 

positional data and viewpoint data, makes calculations for terminal 13 is established by the communication device 24, 

correction as required, and generates the image data corre- upon which the process goes to step S42. 

sponding to the correct position and viewpoint. Then, the In step S42, a connection control table stored in the RAM 

CPU 41 outputs the generated image data to the display 65 23 is updated by the CPU 21. Namely, it is necessary for the 

device 45. Thus, the image (virtual reality space) corre- shared server terminal 11 to recognize the client terminal 13 

sponding to the viewpoint and position entered from the with which the shared server terminal 11 is linked, in order 
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to transmit update information coming from the client 
terminal 13 to other client terminals. To do so, when the 
communication link with client terminals has been 
established, the shared server terminal 11 registers the 
information for identifying the linked client terminals in the 
connection control table. That is, the connection control 
table provides a list of the client terminals currently linked 
to the shared server terminal 11. The information for iden- 
tifying the client terminals include the source IP address 
transmitted from each client terminal as the header of 
TCP/IP packet and a nickname of the avatar set by the user 
of each client terminal. 

Then, the process goes to step S43, in which the com- 
munication device 24 determines whether the update infor- 
mation has come from the client terminal 13. If, in step S43, 
no update information has been found, the process goes to 
step S45 by skipping step S44. If the update information has 
been found, namely, if the client terminal 13 has transmitted, 
in step S10 of FIG. 15, positional data and viewpoint data as 



10 



15 



the update information to the shared server terminal 11 (or, 20 displayed). 



the shared server terminal 11, and the mapping server 
terminal 12 will be described with reference to FIG. 19. 
When the user desires to get a virtual reality space, the user 
enters the URL (the virtual reality space URL) correspond- 
ing to the virtual reality space of the desired area. Then, the 
entered URL is transmitted from the client terminal 13 to the 
information server terminal 10 (hup). Receiving the URL 
from the client terminal 13, the information server terminal 
10 transmits the data (three-dimensional scene data repre- 
senting only basic objects) of the virtual reality space 
associated with the URL to the client terminal 13. The client 
terminal 13 receives and display these data. 

It should be noted that, at this stage of processing, no link 
is established between the client terminal 13 and the shared 
server terminal 11, so that the client terminal 13 does not 
receive update information; therefore, a virtual reality space 
composed of only basic objects, namely a virtual reality 
space shown only a still street for example, is shown (that is, 
no update objects such as avatars of other users are 



in step S4 of FIG. 15, the client terminal 13 has transmitted 
the avatar as the update information to the shared server 
terminal 11 after transmission of the connection request), the 
update information is received by the communication device 
24, upon which the process goes to step S44. In step S44, the 
CPU 21 references the connection control table stored in the 
RAM 23 to transmit the update information received by the 
communication device 24 to other client terminals than the 
client terminal which transmitted that update information. At 
this moment, the source IP address of each client terminal 
controlled by the connection control table is used. 

It should be noted that the above-mentioned update infor- 
mation is received by the client terminal 13 in step S6 of 
FIG. 15 as described above. 

Then, the process goes to step S45, in which the CPU 21 
determines whether the end of processing has been 
instructed by the client terminal 13. If the end of processing 
has not been instructed, the process goes back to S41 by 
skipping step S46. If the end of processing has been 
instructed, the process goes to step S46. In step S46, the link 
with the client terminal 13 from which the instruction has 
come is disconnected by the communication device 24. 
Further, from the connection control table, the information 
associated with the client terminal 13 is deleted by the CPU 
21, upon which the process goes back to step S41. 

Thus, the control of the update objects is performed by the 
shared server terminal 11 and the control (or provision) of 
the basic objects is performed by the information server 
terminal 10 constituting the WWW of the Internet used 
world-wide, thereby easily providing virtual reality spaces 
that can be shared by unspecified users world-wide. It should 
be noted that the specifications of the existing WWW system 
need not be modified to achieve the above-mentioned objec- 
tive. 

Provision of the virtual reality space data by use of the 
WWW system need not create any new web browser 
because the transfer of these data can be made using related 
art web browsers such as the Netscape Navigator 
(trademark) offered by Netscape Communications, Inc. for 
example. 

Moreover, because the IP address of the shared server 
terminal 11 is provided by the mapping server terminal 12, 
the user can share a virtual reality space with other users 
without knowing the address of the shared server terminal. 

In what follows, a procedure of communications between 
the client terminal 13, the information server terminal 10, 
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Further, the address acquisition URL related to the virtual 
reality space URL is transmitted from the client terminal 13 
to the mapping server terminal 12. The mapping server 
terminal 12 receives the address acquisition URL to transmit 
the IP address (the IP address of a shared server terminal 
controlling update objects located in the virtual reality space 
of the area related to the virtual reality space URL, for 
example, the shared server terminal 11) related to the 
received address acquisition URL to the client terminal 13. 

Here, it is possible that the IP address related to the 
address acquisition URL transmitted by the client terminal 
13 is not registered in the mapping server terminal 12. 
Namely, a shared server terminal for controlling the update 
objects located in the virtual reality space of the area related 
to the virtual reality space URL may not be installed or 
operating for example. In such a case, the IP address of the 
snared server terminal cannot be obtained, so that a virtual 
reality space composed of only basic objects, a virtual reality 
space showing only a still street for example, is displayed. 
Therefore, in this case, sharing of a virtual reality space with 
other users is not established. Such a virtual reality space can 
be provided only by storing the virtual reality space data 
(namely, basic objects) in an information server terminal (a 
WWW server terminal) by the existing WWW system. This 
denotes that the cyberspace system according to the present 
invention is upward compatible with the existing WWW 
system. 

Receiving the IP address (the IP address of the shared 
50 server terminal 11) from the mapping server terminal 12, the 
client terminal 13 transmits a connection request to a shared 
server terminal corresponding to the IP address, namely the 
shared server terminal 11 in this case. Then, when a com- 
munication link is established between the client terminal 13 
and the shared server terminal 11, the client terminal 13 
transmits the avatar (the three-dimensional representation of 
the user) representing itself to the shared server terminal 11. 
Receiving the avatar from the client terminal 13, the shared 
server terminal 11 transmits the received avatar to the other 
client terminals linked to the shared server terminal 11. At 
the same time, the shared server terminal 11 transmits the 
update objects (shapes of shared three-dimensional objects), 
the other users' avatars, located in the virtual reality space 
of the area controlled by the shared server terminal 11, to the 
client terminal 13. 

In the other client terminals, the avatar of the user of the 
client terminal 13 is placed in the virtual reality space to 
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appear on the monitor screens of the other client terminals. In the communication in TCP/IP protocol, a source IP 

In the client terminal 13, the avatars of the other client address and a destination IP address are described in the 

terminals are placed in the virtual reality space to appear on header of a TCP/IP packet. 

its monitor screen. As a result, all the users of the client Meanwhile, an IP address is made up of 32 bits and 

terminals linked to the shared server terminal 11 share the 5 normally expressed in a decimal notation delimited by dot in 

same virtual reality space. units of eight bits. For example, an IP is expressed in 

Then, when the shared server terminal 11 receives the 43.0.35.117. This IP address provides an address which 
update information from other client terminals, transmits the uniquely identifies a source or destination terminal con- 
received update information to the client terminal 13. nected to the Internet. Because an IP address expressed in 
Receiving the update information, the client terminal 13 1Q four octets (32 bits) is difficult to remember, a domain name 
changes the display (for example, the position of the avatar is used. The domain name system (DNS) is provided to 
of another user is changed). When the state of the avatar of control the relationship between the domain names assigned 
the user of the client terminal 13 is changed by that user, the to the terminals all over the world and their IP addresses. The 
update information reflecting that change is transmitted from DNS answers a domain name for a corresponding IP address 
the client terminal 13 to the shared server terminal U. and vice versa. The DNS functions based on the cooperation 
Receiving this update information, the shared server termi- 15 of the domain name servers installed all over the world. A 
nal 11 transmits the same to the client terminals other than domain name is expressed in "hanaya@ipd.sony.co.jp" for 
the client terminal 13. Thus, on these other client terminals, example, which denotes a user name, @ a host name, an 
the state of the avatar of the user of the client terminal 13 is organization name, an organization attnbute, and country 
changed accordingly (namely, the state of the avatar is name (in the case of US, the country name is omitted) in this 
changed as the same has been changed by the user of the 20 order. If the country name of the first layer is "jp", that 
client terminal 13 on the same). terminal is located in Japan. If there is no country name, that 

Subsequently, the processing in which the client terminal terminal is located in US. 

13 transmits the update information about the avatar of its Using a domain name server 130 as shown FIG. 23, the 

own and receives the update information from the shared mapping server terminal 12 identifies the installation loca- 

server terminal 11 to change the display based on the tion of the client terminal that transmitted the address 

received update information continues until the connection acquisition URL to the mapping server terminal, 

with the shared server terminal 11 is disconnected. To be more specific, the mapping server terminal asks the 

Thus, the sharing of the same virtual reality space is domain name server 130 controlling the table listing the 
established by transferring the update information via the 30 relationship between the source IP addresses of the request- 
shared server terminal 11 among the users. Therefore, if the ing client terminal and the domain names assigned with the 
shared server terminal 11 and the client terminal 13 are IP addresses for the corresponding domain name. Then, the 
located remotely, there occurs a delay in the communication mapping server terminal identifies the country in which a 
between these terminals, deteriorating the response in the specific client terminal is installed based on the first layer of 
communication. To be more specific, if the shared server 35 the domain name of the client terminal obtained from the 
terminal 11 is located in US for example and users in Japan domain name server 130. 

are accessing the same, update information of user A in In this case, since the client terminal used by each user 

Japan is transmitted to user B in Japan via US, thereby and its shared server terminal are located in geographical 

taking time until a change made by user Ais reflected in user proximity to each other, the above-mentioned problem of a 

g 40 delay, or the deterioration of response time is solved. 

To overcome such a problem, rather than installing only In this case, the virtual reality space provided to the users 

one shared server terminal in the world, a plurality of shared in Japan and US is the same amusement park' s virtual reality 

server terminals are installed all over the world. And the IP space as mentioned above. However, since the shared server 

addresses of the plurality of shared server terminals are terminals that control the sharing are located in both 

registered in the mapping server terminal 12 to make the 45 countries, the sharing by the users in Japan is made inde- 

same provide the IP address of the shared server terminal in pendently of the sharing by the users in US. Namely, the 

the geographical proximity to the client terminal 13. same virtual reality space is shared among the users in Japan 

To be more specific, as shown in FIG. 20, a shared server and shared among the users in US. Therefore, in this case, 

terminals Wl and W2 for controlling the update objects the same virtual reality space is provided from the informa- 

placed in a virtual reality space (a three-dimensional space) 50 tion s*™* terminal 10, but separate shared spaces are 

such as an amusement park are installed in Japan and US constructed among the users in both countries, thereby 

respectively by way of example. When the users in Japan enabling the users to make a chat in their respective lan- 

and US have received the data of the amusement park's g ua ges. 

virtual reality space, each user transmits an address acqui- However, it is possible for the users of both countries to 

sition URL related to a virtual reality space URL corre- 55 share the same virtual reality space by making connection 

sponding to the amusement park's virtual reality space to the between the shared server terminals Wl and W2 to transfer 

mapping server terminal 12 (the same address acquisition update information between them. 

URL is transmitted from all users). At this moment, the users The deterioration of response also occurs when the excess 

in Japan transmit the IP address of the shared server terminal number of users access the shared server terminal 11. This 

Wl installed in Japan to the mapping server terminal 12, 60 problem can be overcome by installing a plurality of shared 

while the users in US transmit the IP address of the shared server terminals for controlling the update objects placed in 

server terminal W2 installed in US to the mapping server the virtual reality space in the same area in units of specific 

terminal 12. areas, for example, countries or prefectures and making the 

Here, the mapping server terminal 12 identifies the instal- mapping server terminal 12 provide the addresses of those 

lation locations of the client terminals that transmitted the 65 shared server terminals which are accessed less frequently, 

address acquisition URLs to the mapping server terminal in To be more specific, a plurality of shared server terminals 

the following procedure. W3, W4, W5, and so on are installed and the mapping server 
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terminal 12 is made provide the IP address of the specific 
shared server terminal W3 for example for specific URLS. 
Further, in this case, communication is performed between 
the mapping server terminal 12 and the shared server 
terminal W3 for example to make the shared server terminal 5 
W3 transmit the number of client terminals accessing the 
shared server terminal W3 to the mapping server terminal 
12. Then, when the number of client terminals accessing the 
shared server terminal W3 has exceeded a predetermined 
level (100 terminals for example, which do not deteriorate 10 
the response of the shared server terminal W3) and if the 
mapping server terminal 12 has received another URL, the 
mapping server terminal 12 provides the IP address of 
another shared server terminal W4 for example (it is desired 
that the W4 be located in the proximity to the shared server 15 
terminal W3). 

It should be noted that, in this case, the shared server 
terminal W4 may be put in the active state in advance; 
however, it is also possible to start the shared server W4 
when the number of client terminals accessing the shared 20 
server W3 has exceeded a predetermined value. 

Then, communication is performed between the mapping 
server terminal 12 and the shared server terminal W4, When 
the number of client terminals accessing the shared server 
terminal W4 has exceeded a predetermined value, and the 25 
mapping server terminal 12 has received another URL, the 
mapping server terminal 12 provides the IP address of the 
shared server terminal W5 (however, if the number of client 
terminals accessing the shared server terminal W3 has 
dropped below the predetermined level, the mapping server 30 
terminal 12 provides the IP address of the W3). 

This setup protects each of the shared server terminals 
W3, W4, W5 and so on from application of excess load, 
thereby preventing the deterioration of response. 

It should be noted that the above-mentioned capability 
can be implemented by controlling by the mapping server 
terminal 12 the IP addresses of shared server terminals to be 
outputted for specific URLs, so that the client terminal 13 
and the software operating on the same need not be modi- 
fied. ° 

The present embodiment has been described by taking the 
user's avatar for example as the update object to be con- 
trolled by the shared server terminal 11; it is also possible to 
make the shared server terminal control any other update 45 
objects than avatars. It should be noted, however, that the 
client terminal 13 can also control update objects in some 
cases. For example, an update object such as a clock may be 
controlled by the client terminal 13 based on the built-in 
clock of the same, updating the clock. 50 

Further, in the present embodiment, as shown in FIG. 1, 
the hosts A through C, the client terminals 13-1 through 
13-3, and the service provider terminal 14 are interconnected 
via the network 15, which is the Internet; however, in terms 
of using the existing WWW system, the host A having the ss 
information server terminal 10 or the host C having the 
mapping server terminal 12 may only be connected with the 
client terminal 13 via the Internet. Further, if the user 
recognizes the address of the shared server terminal 11 for 
example, the host A having the information server terminal 60 
10 and the client terminal 13 may only be interconnected via 
the Internet. 

In addition, in the present embodiment, the information 
server terminal 10 and the mapping server terminal 12 
operate on different hosts; however, if the WWW system is 65 
used, these server terminals may be installed on the same 
host. It should be noted that, if the WWW system is not used, 
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the information server terminal 10, the shared server termi- 
nal 11, and the mapping server terminal 12 may all be 
installed on the same host. 

Still further, in the present embodiment, the data of the 
virtual reality spaces for each specific area are stored in the 
host A (namely, the information server terminal 10); 
however, these data may also be handled in units of a 
department store or an amusement park for example. 

In the above-mentioned preferred embodiments of the 
invention, the basic objects are supplied to each client 
terminal 13 via the network 15; however, it is also possible 
to store the basic objects in an information recording 
medium such as a CD-ROM and distribute the same to each 
user in advance. In this case, each client terminal 13 is 
constituted as shown in FIG. 21. To be more specific, in the 
embodiment of FIG. 21, a CD-ROM drive 100 is connected 
to the interface 48 to drive a CD-ROM 101 in which a virtual 
reality composed of basic objects is stored. The other part of 
the constitution is the same as that of FIG. 7. 

Thus, provision of the data of basic objects from the 
CD-ROM 101 eliminates the time for transferring the data 
via the network 15, increasing processing speed. 

Alternatively, the data of basic objects supplied from the 
information server terminal 10 may be stored in the storage 
device 50 only for the first time to be subsequently read for 
use. 

Namely, as shown in FIG. 2, the basic object data can be 
stored in the storage device 85 of the information server 
terminal 10 (for the cases 1 through 3), the storage device 50 
of the client terminal 13 (for the cases 4 through 6) or the 
CD-ROM 101 of the client terminal 13 (for the cases 7 
through 9). 

On the other hand, the update object data can be stored in 
the storage device 85 of the information server terminal 10 
(for the case 1) or the storage device 30 of the shared server 
terminal 11 (for the cases 2 through 9). In the case in which 
the update object data are stored in the shared server 
terminal 11, that shared server terminal may be the shared 
server terminal 11-1 in Japan (for the case 2, 5 or 8) or the 
shared server terminal 11-2 in US (for the case 3, 6 or 9) as 
shown in FIG. 23 for example. In this iastance, the URL of 
the update object data is stored on the mapping server 
terminal 12. 

If the update object data are stored on the information 
server terminal 10, the URL of the update object data is the 
default URL controlled by the information server terminal 
10 (in the case of 1). Or if the shared server terminal 11 is 
specified by the user manually, the URL of update object 
data is the specified URL (in the case of 4 or 7). 

Referring to FIG. 23, the data in each of the above- 
mentioned cases in FIG. 22 flows as follows. In the case 1, 
the basic object data are read from a VRML file (to be 
described later in detail) stored in an HDD (Hard Disk 
Drive), storage device of a WWW server terminal 121 
operating as the information server terminal 10 to be sup- 
plied to the client terminal 13-1 for example via the Internet 
15A operating as the network 15. The storage device of the 
WWW server terminal 121 also stores update object data. To 
be more specific, when the basic object data are read in the 
WWW server terminal 121, the URL of the corresponding 
update object data is stored as the default URL in the storage 
device of the WWW server terminal 121 in advance. From 
this default URL, the update object data are read to be 
supplied to the client terminal 13-1. 

In the case 2, the basic object data are supplied from the 
WWW server terminal 121 to the client terminal 13-1 in 



04/26/2004, EAST Version: 1.4.1 



6,057 : 

23 

Japan via the Internet 15A. On the other hand, the update 
object data are supplied from the shared server terminal 11-1 
in Japan specified by the mapping server terminal 12 to the 
client terminal 13-1 via the Internet 15A. 

In the case 3, the basic object data are supplied from the 5 
WWW server terminal 121 to the client terminal 13-2 in US 
via the Internet 15 A. The update object data are supplied 
from the shared server terminal 11-2 in US specified by the 
mapping server terminal 12 via the Internet 15A. 

In the case 4, the basic object data are stored in advance 30 
in the storage device 50 of the client terminal 13-1 in Japan 
for example. The update object data are supplied from the 
shared server terminal 11-2 in US for example specified by 
the client terminal 13-1. 

In the case 5, the basic object data are stored in advance 
in the storage device 50 of the client terminal 13-1. The 
update object data are supplied from the shared server 
terminal 11-1 in Japan specified by the mapping server 
terminal 12 via the Internet 15A. 2Q 

In the case 6, the basic object data are stored in advance 
in the storage device 50 of the client terminal 13-2 in US. 
The update object data are supplied from the shared server 
terminal 11-2 in US specified by the mapping server termi- 
nal 12 to the client terminal 13-2 via the Internet ISA 2 5 

In the case 7, the basic object data stored in the CD-ROM 
101 are supplied to the client terminal 13-1 in Japan for 
example via the CD-ROM drive 100. The update object data 
are supplied from the shared server terminal (for example, 
the shared server terminal 11-1 or 11-2) specified by the 30 
client terminal 13-1. 

In the case 8, the basic object data are supplied from the 
CD-ROM 101 to the client terminal 13-1. The update object 
data are supplied from the shared server terminal 11-1 in 
Japan specified by the mapping server terminal 12 in Japan. 35 

In the case 9, the basic object data are supplied from the 
CD-ROM 101 to the client terminal 13-2 in US. The update 
object data are supplied from the shared server terminal 11-2 
in US specified by the mapping server terminal 12 via the 
Internet 15A. 40 

In what follows, the software for transferring the above- 
mentioned virtual reality space data to display the same on 
the display device. In the WWW system, document data are 
transferred in a file described in HTML (Hyper Text Markup 45 
Language). Therefore, text data are registered as an HTML 
file. 

On the other hand, in the WWW system, three- 
dimensional graphics data are transferred for use by describ- 
ing the same in VRML (Virtual Reality Modeling Language) 5 0 
or E-VRML (Enhanced Virtual Reality Modeling 
Language). Therefore, as shown in FIG. 24 for example, a 
WWW server terminal 112 of remote host 111 constituting 
the above-mentioned information server terminal 10, the 
shared server terminal 11 or the mapping server terminal 12 55 
stores in its storage device both HTML and E-VRML files. 

In an HTML file, linking between different files is per- 
formed by URL. In a VRML or E-VRML file, such attributes 
as WWW Anchor and WWW Inline can be specified for 
objects. WWW Anchor is an attribute for linking a hyper text 60 
to an object, a file of link destination being specified by 
URL. WWW Inline is an attribute for describing an external 
view of a building for example in parts of external wall, roof, 
window, and door for example. An URL can be related to 
each of the parts. Thus, also in VRML or E-VRML files, link 65 
can be established with other files by means of WWW 
Anchor or WWW Inline. 
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For application software (a WWW browser) for notifying 
a WWW server terminal of a URL entered in a client 
terminal in the WWW system to interpret and display an 
HTML file coming from the WWW server terminal, 
Netscape Navigator (register trade name) (hereafter referred 
to simply as Netscape) of Netscape Communications, Inc. is 
known. For example, the client terminal 13 also uses 
Netscape to user the capability for transferring data with the 
WWW server terminal 

It should be noted, however, that this WWW Browser can 
interpret an HTML file and display the same; but this WWW 
browser cannot interpret and display a VRML or E-VRML 
file although it can receive these files. Therefore, a VRML 
browser is required which can interpret a VRML file and an 
E-VRML file and draw and display them as a three- 
dimensional space. 

Details of VRML are disclosed in the Japanese translation 
of "VRML: Browsing & Building Cyberspace," Mark 
Pesce, 1995, New Readers Publishing, ISBN 1-56205-498- 
8, the translation being entitled "Getting to Know VRML: 
Building and Browsing Three -Dimensional Cyberspace/* 
translated by Kouichi Matsuda, Terunao Gamaike, Shouichi 
Takeuchi, Yasuaki Honda, Junichi Rekimoto, Masayuki 
Ishikawa, Takeshi Miyashita and Kazuhiro Hara, published 
Mar. 25, 1996, Prenticehall Publishing, ISBN4-931 356-37- 
0. 

The applicant hereof developed Community Place 
(trademark) as application software that includes this VRML 
browser. 

Community Place is composed of the following three 
software programs: 

(1) Community Place Browser 

This is a VRML browser which is based on VRML 1 .0 
and prefetches the capabilities (motion and sound) of VRML 
2.0 to support E-VRML that provides moving picture capa- 
bility. In addition, this provides the multi-user capability 
which can be connected to Community Place Bureau. For 
the script language, TCUTK is used. 

(2) Community Place Conductor 

This is a VRML authoring system which is based on 
E-VRML based on VRML 1 .0. This tool can not only simply 
construct a three-dimensional world but also give a 
behavior, a sound, and an image to the three -dimensional 
world with ease. 

(3) Community Place Bureau 

This is used for a server terminal system for enabling 
people to meet each other in a virtual reality space con- 
structed on a network, connected from the Community Place 
Browser. 

In the client terminals 13-1 and 13-2 shown in FIG. 23, 
Community Place Browser is installed in advance and 
executed. In the shared server terminals 11-1 and 11-2, 
Community Place Bureau is installed in advance and 
executed. FIG. 25 shows an example in which Community 
Place Browser is installed from the CD-ROM 101 and 
executed on the client terminal 13-1 and, in order to imple- 
ment the shared server terminal capability and the client 
terminal capability on a single terminal, Community Place 
Bureau Browser and Community Place Bureau Browser are 
installed from the CD-ROM 101 in advance and executed. 

As shown in FIG. 24, Community Place Bureau Browser 
transfers a variety of data with Netscape as a WWW browser 
based on NCAPI (Netscape Client Application Program- 
ming Interface) (trademark). 

Receiving an HTML file and a VRML file or E-VRML file 
from the WWW server terminal 112 via the Internet, 
Netscape stores the received files in the storage device 50. 
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Netscape processes only the HTML file. The VRML or 
E-VRML file is processed by Community Place Browser. 

E-VRML is an enhancement of VRML 1.0 by providing 
behavior and multimedia (sound and moving picture) and 
was proposed to the VRML Community, September 1995, as 
the first achievement of the applicant hereof. Then, the basic 
model (event model) for describing motions as used in 
E-VRML was inherited to the Moving Worlds proposal, one 
the VRML 2.0 proposals. 

In what follows, Community Place Bureau Browser will 
be outlined. After installing this browser, selecting 
"Manual" from "Community Place Folder" of "Program" of 
the start menu of Windows 95 (trademark) (or in Windows 
NT (trademark), the Program Manager) displays the instruc- 
tion manual of the browser. 

It should be noted that Community Place Browser, Com- 
munity Place Conductor, Community Place Bureau, and the 
files necessary for operating these software programs are 
recorded in a recording medium such as the CD-ROM 101 
to be distributed as a sample. 
Operating Environment of the Browser: 

The operating environment of the browser is as shown in 
FIG. 26. The minimum operating environment must be at 
least satisfied. However, Netscape Navigator need not be 
used if the browser is used as a standalone VRML browser. 
In particular, on using in the multi-user, the recommended 
operating environment is desirable. 
Installing the Browser: 

The browser can be usually installed in the same way as 
Netscape is installed. To be more specific, vscplb3a.exe 
placed in the \Sony (trademark) directory of the above- 
mentioned CD-ROM 101 is used as follows for installation. 

(1) Double-click vscplb3a.exe. The installation package is 
decompressed into the directory indicated by "Unzip To 
Directory" column. The destination directory may be 
changed as required. 

(2) Click "Unzip" button. And the installation package is 
decompressed. 

(3) "12 files unzipped successfully" appears. Click "OK" 
button. 

(4) When "Welcome" windows appeared, click "NEXT' 
button. 

(5) Carefully read "Software License Agreement." If 
agreed, press "Yes" button; if not, press "No" button. 

(6) Check the directory of installation. Default is "Pro- 
gram Files Sony\Community Place." 

(7) If use of the above-mentioned directory is not wanted, 
press "Browse" button and select another directory. Then, 
press "Next" button. 

(8) To read "readme" file here, click "Yes" button. 

(9) When the installation has been completed, click "OK" 
button. 

Starting the Browser: 

Before starting the browser, setting of Netscape Navigator 
must be performed. If the browser is used standalone, this 
setting need not be performed; just select "Community Place 
Folder . . . Community Place" of "Program" of the start 
menu and start. The following setting may be automatically 
performed at installation. 

(1) From "Options" menu of Netscape Navigator, execute 
"General Preference" and open "Preference" window. From 
the upper tab, select "Helper Applications." 

(2) Check "File type" column for "x-worlaVx-vrml". If it 
is found, go to (4) below. 

(3) Click "Create New Type" button. Enter "x-world" in 
"Mime Type" column and "x-vrml" in "Mime SubType" 
column. Click "OK" button. Enter "wrl" in "Extensions" 
column. 
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(4) Click "Launch the Application:" button. Enter the path 
name of Community Place Browser in the text column 
below this button. Default is "\Program 
Files\Sony\Community Place\bin\vscp.exe". 
s (5) Click "OK" button. 

Thus, the setting of Netscape Navigator has been com- 
pleted. Start the browser as follows: 

(1) In "File. Open File" menu of Netscape, read "readme- 
.htm" of the sample CD-ROM 101. 

(2) Clicking the link to the sample world, and Community 
Place is automatically started, loading the sample world 
from the CD-ROM 101. 

Uninstalling the Browser: 

Execute "Uninstall" from "Community Place Folder" of 
"Program" of the start menu (or in Windows NT, the 
15 Program Manager), the browser will be uninstalled auto- 
matically. 

Operating the Browser: 

The browser may be operated intuitively with the mouse 
49b, the keyboard 49a, and the buttons on screen. 

20 Moving Around in the Three-Dimensional Space: 

In the three-dimensional space provided by VRML> such 
movements done in real world as forward, backward, rotate 
right and rotate left for example can be done. The browser 
implements such movements through the following user 

25 interface: 
By Keyboard: 

Each of the arrow keys, not shown, on the keyboard 49a 
generates the following corresponding movement: 
rotate right 

«- rotate left 

f move forward 

I move backward. 
By Mouse: 

35 Operate the mouse all with its left button. 

(1) Keep the left button of the mouse 496 pressed in the 
window of CyberPassage and move the mouse rightward for 
rotate right; 

leftward for rotate left; 
40 up for forward; and 

down for backward. The velocity of movement depends 
on the displacement of the mouse. 

(2) With the Ctrl (Control) key, not shown, on the key- 
board 49a kept pressed, click an object on screen to get to 

45 the front of the clicked object. 

The Following Precautions Are Needed: 

If a collision with an object occurs, a collision sound is 

generated and the frame of screen blinks in red. If this 

happens, any forward movement is blocked. Moving direc- 
50 tions must be changed. 

If the user is lost or cannot see anything in the space, click 

"Home" button on the right of screen, and the user can return 

to the home position. 

Jumping Eye: 

55 While navigating through a three-dimensional space, the 
user may be lost at occasions. If this happens, the user can 
jump up to have an overhead view around. 

(1) Click "Jump" button on the right of screen, and the 
user enters the jumping eye mode and jump to a position 

60 from which the user look down the world. 

(2) Click "Jump" button again, and the user goes down to 
the original position. 

(3) Alternatively, click any place in the world, and the user 
gets down to the clicked position. 

65 Selecting An Object: 

When the mouse cursor is moved around on the screen, 
the shape of the cursor is transformed into a grabber (hand) 
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on an object. In this state, click the left button of the mouse 
49b, and the action of the grabbed object can be called. 
Loading a VRML File: 

A VRML file can be loaded as follows: 

In Netscape, click the link to the VRML file, 5 

From "File. Open File" menu of Community Place 
Bureau, select the file having extension "wrl" on disc. 

In "File. Open URL" menu of Community Place Bureau, 
enter the URL. 

Click the object in the virtual space for which "URL" is 
displayed on the mouse cursor. 
Operating Toolbar Buttons: 

Buttons in the toolbar shown in FIG. 30 for example may 
be used to execute frequently used functions. 
"Back" Go back to the world read last. 
"Forward" Go to the world after going back to the previous 15 

world. 

"Home" Move to the home position. 

"Undo" Return a moved object to the original position (to be 

described later). 
"Bookmark" Attach a book to the current world or position. 20 
"Scouter" Enter in the scouter mode (to be described later). 
"Jump" Enter in the jump eye mode. 
Scouter Mode: 

Each object placed in a virtual world may have a character 
string as information by using the E-VRML capability. 2 5 

(1) Click "Scouter" button on the right of screen, and the 
user enters the scouter mode. 

(2) When the mouse cursor moves onto an object having 
an information label, the information label is displayed. 

(3) Click "Scouter" button again, and the user exits the 3Q 
scouter mode. 

Moving an Object Around: 

With "Alt" (Alternate) key, not shown, on the keyboard 
49a pressed, press the left button of the mouse 49b on a 
desired object, and the user can move that object to a desired 
position with the mouse. This is like moving a coffee cup for 35 
example on s desk with the hand in the real world. In the 
virtual reality, however, objects that can be moved are those 
having movable attributes. It should be noted that a moved 
object may be restored to the position before movement only 
once by using "Undo" button. 40 
Connecting to a Multi-User Server Terminal: 

This browser provides a multi-user capability. The multi- 
user capability allows the sharing of a same VRML virtual 
space among a plurality of users. Currently, the applicant 
hereof is operating Community Place Bureau in the Internet 45 
on an experimental basis. By loading a world called chat- 
room the server terminal can be connected to share a same 
VRML virtual space with other users, walking together, 
turning off a room light, having a chat, and doing other 
activities. 50 
This Capability is Started as Follows: 

(1) Make sure that the user's personal computer is linked 
to the Internet. 

(2) Load the Chatroom of the sample world into Cyber- 
Passage Browser. This is done by loading 55 
"\Sonv\readme.htm" from the sample CD-ROM 101 click- 
ing "Chat Room". 

(3) Appearance of "Connected to VS Server" in the 
message window indicates successful connection. 

Thus, the connection to the server has been completed. 60 
Interaction with other users is of the following two types: 
Telling Others of an Action: 

This is implemented by clicking any of "Hello", "Smile", 
"Wao!", "Wooo! !", "umm . . "Sad", "Bye" and so on in 
the "Action" window. The actions include rotating the user 65 
himself (avatar) right or left 36 degrees, 180 degrees or 360 



Talking with Others: 

This capability is implemented by opening the "Chat" 
window in "View. Chat" menu and entering a message from 
the keyboard 49a into the bottom input column. 
Multi-User Worlds: 

The following three multi-user worlds are provided by the 
sample CD-ROM 101. It should be noted that chat can be 
made throughout these three worlds commonly. 

(1) Chat Room 

This is a room in which chat is made mainly. Some objects 
in this room are shared among multiple users. There are 
objects which are made gradually transparent every lime the 
left button of the mouse is pressed, used to turn off room 
lights, and hop when clicked, by way of example. Also, there 
are hidden holes and the like. 

(2) Play with a ball! 

When a ball in the air is clicked, the ball flies toward the 
user who clicked the ball. This ball is shared by all users 
sharing that space to play catch. 

(3) Share your drawing 

A whiteboard is placed in the virtual space. When it is 
clicked by the left button, the shared whiteboard is dis- 
played. Dragging with the left button draws a shape on the 
whiteboard, the result being shared by the users sharing the 
space. 

Use of Community Place Bureau allows the users using 
Community Place Browser to enter together a world 
described in VRML 1.0. To provide a three-dimensional 
virtual reality space for enabling this capability, a file 
described in VRML 1.0 must be prepared. Then, the Bureau 
(Community Place Bureau being hereinafter appropriately 
referred to simply as the Bureau) is operated on an appro- 
priate personal computer. Further, a line telling the personal 
computer on which Bureau is operating is added to the 
VRML 1.0 file. The resultant VRML file is read into 
Community Place Browser (hereinafter appropriately 
referred to simply as the Browser), so that the Browser is 
connected to the Bureau. 

If this connection is successful, the users in the virtual 
world can see each other and talk each other. Further, writing 
an appropriate script into the file allows each user to express 
emotions through a use of action panel ("Action" part in a 
multi-user window 202 of FIG. 29 to be described later). 

Community Place Browser provides interface for action 
description through use of TCL. This interface allows each 
user to provide behaviors to objects in the virtual world and, 
if desired, make the resultant objects synchronize between 
the Browsers. This allows a plurality of users to play a 
three-dimensional game if means for it are prepared. 

To enjoy a multi-user virtual world, three steps are 
required, preparation of a VRML file, start of the Bureau, 
and connection of the Browser. 
Preparing a VRML File: 

First, a desired VRML. 1.0 file must be prepared. This file 
is created by oneself or a so-called freeware is used for this 
file. This file presents a multi-user virtual world. 
Starting the Bureau: 

The operating environment of Community Place Bureau 
is as follows: 

CPU . . . 486SX or higher 

OS . . . Window 95 

Memory . . . 12MB or higher 

This Bureau can be started only by executing the down- 
loaded file. When the CyberPassage Bureau is executed, 
only a menu bar indicating menus is displayed as shown in 
FIG. 27. Just after starting, the Bureau is in stopped state. 
Selecting "status" by pulling down "View" menu displays 
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the status window that indicates the current Bureau state. At 
the same time, a port number waiting for connection is also 
shown. 

Immediately after starting, the Bureau is set such that it 
waits for connection at TCP port No. 5126. To change this 5 
port number, pull down "options" menu and select "port". 
When entry of a new port number is prompted, enter a port 
number 5000 or higher. If the user does not know which port 
number to enter, default value (5126) can be used. 

To start the Bureau from the stopped state, pull down 10 
"run" menu and select "start". The server terminal comes to 
be connected at the specified port. At this moment, the state 
shown in "status" window becomes "running". 

Thus, after completion of the bureau preparations, when 
the Browser comes to connect to the Bureau, it tells the 15 
position of the Browser to another Browser or transfers 
information such as conversation and behavior. 

The "status" window of the Bureau is updated every time 
connection is made by the user, so that using this window 
allows the user to make sure of the users existing in that 20 
virtual world. 

Connection of the Browser: 

Connection of the Browser requires the following two 
steps. First, instruct the Browser to which Bureau it is to be 
connected. This is done by writing an "info" node to the 25 
VRML file. Second, copy the user's avatar file to an appro- 
priate direction so that you can be seen from other users. 
Adding to a VRML File: 

When writing a line specifying the Bureau to be con- 
nected to the VRML file, a name of the personal computer 30 
on which the Bureau is operating and the port number must 
be specified in the following format: 
DEF VsServer Info {string" server name:port number" } 

The server terminal name is a machine name as used in 
the Internet on which the Bureau is operating (for example, 35 
fred.research.sony.com) or its IP address (for example, 
123.231.12.1). The port number is one set in the Bureau. 

Consequently, the above-mentioned format becomes as 
follows for example: 

DEF VsServer Info {string^ed.research.sony.comiS^e'' } 40 

In the example of FIG. 25, the IP address of the shared 
server terminal 11-1 is 43.0.35.117, so that the above- 
mentioned format becomes as follows: 
DEF VsServer Info {string" 43. 0.35. 117: 5126" } 

This is added below the line shown below of the prepared 45 
VRML file:#VRML V1.0 ascii 
Copying an Avatar File: 

When Community Place Browser gets connected to Com- 
munity Place Bureau, the former notifies the latter of its 
avatar. When a specific avatar meets another, the Bureau 50 
notifies the other Browsers of the meeting information to 
make the specific avatar be displayed on the other Browsers. 
For this reason, it is required to copy the VRML file of the 
specific avatar to an appropriate place in advance. 

The following describes control of Browsers (the client 55 
terminal 13) in the Bureau (the shared server terminal 11). 

The Bureau controls the Browsers connected thereto by a 
user control table shown in FIG. 27 for example. 

Namely, a Bureau (the shared server terminal U), when 
the Browser (the client terminal 13) comes to connect 60 
thereto, assigns a unique user ID to the Browser. In addition, 
the Bureau gets, from the Browser, a nickname of the user 
(the avatar) of this Browser, various avatar parameters to be 
used by the user, and the coordinates (the shared space 
coordinates) (positional information) of the avatar in the 65 
virtual reality space and enters the obtained information into 
the user control table (hereinafter, appropriately referred to 



the shared data). In the embodiment of FIG. 27(A), integer 
user IDs beginning from 1 are sequentially assigned to the 
Browsers in the order in which the Browsers have come to 
connect to the Bureau. FIG. 27(A) shows the user control 
table of 64 Browsers (users) coming to connect to the 
Bureau. 

When the Bureau has entered the user ID of the Browser 
that came to connect to the Bureau and the shared data into 
the user control table, the Bureau recognizes the users 
around that user by referencing the user control table, puts 
the user ID of that user and the shared data into a table 
(hereafter appropriately referred to as a surrounds informa- 
tion table) as shown in FIG. 27(B) for example, and sends 
this table to a Browser coming for connection. This sur- 
rounds information table is equivalent to the above- 
mentioned update information. Therefore, each Browser 
uses this surrounds information table to update the states of 
avatars of other users. Moreover, each Browser implements 
a radar capability to be described later by use of the 
surrounds information table. 

The following describes a method of generating the 
surrounds information table with reference to FIG. 28 show- 
ing a shared virtual reality space controlled by the Bureau 
(the shared server terminal 11). 

The Bureau, when a Browser comes to connect to the 
Bureau, sets a solid sphere having a predetermined radius Rv 
around the user of the Browser as a visible area (visual aura). 
Then, the Bureau recognizes other users existing in this 
visible area from the shared space coordinates entered in the 
user control table TA(FIG. 27(A)). The Bureau puts the user 
IDS and the shared data of the recognized users into a table 
to generate the surrounds information table TB shown in 
FIG. 27(B). Therefore, the surrounds information table TB 
shown in FIG. 27(B) indicates that the table has been 
generated when 10 users having user IDS 02 through 11 are 
present in the solid sphere having radius Rv around the 
position of the user of the Browser that has come for 
connection. 

As described, in each Browser, the states of avatars of 
other users are updated by use of the surrounds information 
table TB. Therefore, if a particular Browser is taken for 
example, information about users not entered in the sur- 
rounds information table TB to be sent to that Browser, 
namely the users outside the visible area, is not at all 
reflected onto the virtual reality space displayed in that 
Browser for the following reasons. 

First, in a real space too, one can see only changes of 
states in a predetermined range around himself. Second, 
when sending information about the users existing in a 
virtual reality space from the Bureau to the Browsers, if the 
number of users in that space is huge, the network traffic is 
also huge. 

It is also possible that many users enter the visible area, 
thereby increasing the network traffic. It is therefore prac- 
ticable to limit the entry of only the information about the 
predetermined number of users (for example, 10 users) into 
the surrounds information table TB. Namely, if the prede- 
termined number of users have entered the visible area, the 
information about users who have subsequently entered in 
the visible area can be prevented from entering the sur- 
rounds information table TB until some users get out of the 
area, by way of example. Alternatively, if the excess number 
of users have entered the visible area, only the information 
about the predetermined number of users existing relatively 
near the center of the visible area can be entered in the 
surrounds information table, by way of example. 

In the embodiment shown in FIG. 28, a chat enable area 
is provided in addition to a visible area. 
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Namely, the Bureau, when a Browser comes to connect to 
the Bureau, sets a solid sphere having predetermined radius 
Ra around the user of that Browser as a chat enable area 
(audio aura) as indicated by a dashed line as shown in FIG. 
28 for example. The Bureau performs control such that chat 
is enabled only between the users existing in this chat enable 
area. The chat enable range is limited because, like the 
above-mentioned visible area, one can talk only with others 
in a predetermined area around him in a real space. In 
addition, the chat enable range is limited to prevent the 
network traffic from getting too large. 

In the embodiment of FIG. 28, the chat enable area is 
smaller than the visible area because, in the real world, an 
audible range is generally narrower than a visible range. It 
should be noted, however, that the chat enable area is not 
necessarily narrower than the visible area. 

It should also be noted that the shapes of the visible area 
and the chat enable area are not limited to solid spheres; 
these areas may take any shapes such as a solid cylinder. 

The radius of the solid sphere, which represents the 
visible area (or the chat enable area) may be either fixed or 
variable. For example, the radius of the visible area may be 
varied in the Bureau to a value that allows to always contain 
a predetermined number of users in the area. Alternatively, 
the radius may be set to any value on the Browser side. 

FIG. 29 shows a display example of a Browser operating 
on the client terminal 13. 

When the Browser is started on the client terminal 13, a 
main window 201 is opened, in which a virtual reality space 
(world) is displayed. Further, when the Browser is connected 
to the Bureau and the surrounds information table TB shown 
in FIG, 27(B) comes from the Bureau (the shared server 
terminal 11), the main window 201 displays the avatar of 
another user based on the surrounds information table TB. In 
the embodiment of FIG. 29, two avatars A and B are 
displayed. 

In the embodiment of FIG. 29, a multi-user window 202 
is opened on the right side of the main window 201. This 
multi-user window 202 is adapted to open when the Browser 
is connected to the Bureau, namely when the same virtual 
reality space is shared by another user. When a character 
string is entered in this multi-user window 202, the entered 
character string is transmitted through the Bureau to another 
Browser (of the user in the chat enable area) connected 
thereto. The multi-user window 202 also displays a character 
string transmitted from such a Browser, thereby enabling 
chat with other users existing in the chat enable area. 

The Browser operating on the client terminal 13 has a 
radar map display capability of recognizing the positions of 
the avatars of other users. Namely, selecting "Radar Map" 
item from the "Multiuser" menu of the main window causes 
the Browser to display a radar map 203 superimposed on the 
virtual reality space at the upper right for example of the 
main window 201. This radar map is a graphic indicating the 
position of another use by red dots in an orthogonal coor- 
dinate system with a cross added to a red circle. 

FIG. 30 shows the radar map 203 in detail. 

The center (intersection) of the red cross of the radar map 
203 corresponds to the position of the user. In the radar map, 
the positions of the other users around this user are shown 
in dots or squares colored red for example. It should be noted 
that, in the embodiment of FIG. 30, the positions of the 
avatars (users) A and B are shown. 

When "Radar Map" item is selected, the Browser gener- 
ates the radar map 203 as described below for example and 
superimposes the generated radar map on the virtual reality 
space displayed in the main window 201. 
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As described, the Browser (the client terminal 13) cap- 
tures the surrounds information table TB coming from the 
Bureau (the shared server terminal 11) and recognizes from 
the shared space coordinates the position of the virtual 

5 reality space in which the other users exist. Then, from the 
positions of the other users and the recognized position, the 
Browser reflects the positions of the other users on the radar 
map 203 and superimposes the resultant radar map on the 
virtual reality space shown in the main window 201. 

10 Therefore, in this embodiment, only the positions of the 
users existing inside the visible area are reflected on the 
radar map 203. 

Thus, the radar map 203 is superimposed on the virtual 
reality space shown in the main window, allowing the user 

15 to take a look at the radar map 203 without much moving his 
sight line, recognizing the positions of the other users with 
ease. 

It should be noted that the radar map 203 may be adapted 
to display not only the positions of the users existing in the 
20 visible area but also the positions of all the users existing in 
the world. 

Conversely, the radar map may be adapted to display the 
positions of only the users existing in a certain partial range. 
The shape of the radar map 203 is not limited to that 
25 mentioned above. 

In the above-mentioned example, the center of the radar 
map 203 represents the position of the user concerned. It will 
be apparent that such a position may be set in any manner. 
In the present embodiment, avatar positions are displayed 
30 in the radar map 203. It will be apparent that the position of 
an update object (for example, three-dimensional graphics 
representing a robot and a dog) other than avatar may be 
displayed in the radar map 203. 

Thus, the present invention has been described by using 
35 the Internet for the network 15 and WWW for example. It 
will be apparent that the present invention may also be 
implemented by using a wide area network 15 rather than the 
Internet and a system other than WWW. 

As described and according to the information processing 
40 apparatus described in claim 1, the information processing 
method described in claim 8, and the information providing 
medium described in claim 9, the positional information 
about the position of an update object existing in a three- 
dimensional virtual reality space is displayed thereon in a 
45 superimposed manner. Consequently, the positional relation- 
ship between one user and another sharing the three- 
dimensional virtual reality space can be recognized with 
ease. At the same time, both the three-dimensional virtual 
reality space and the position of another user can be dis- 
50 played in a minimum display space by effectively using a 
display screen of a computer display for example. 

While the preferred embodiments of the present invention 
have been described using specific terms, such description is 
for illustrative purposes only, and it is to be understood that 
55 changes and variations may be made without departing from 
the spirit or scope of the appended claims. 
What is claimed is: 

1. An information processing apparatus in a three- 
dimensional virtual reality space sharing system in which a 

60 plurality of information processing units for displaying a 
three-dimensional virtual reality space image by acquiring 
three-dimensional graphic data associated with a basic 
object to be commonly used by a plurality of users and an 
update object to be updated according to an operation 

65 performed by each of said plurality of users are intercon- 
nected with a shared server terminal for transferring update 
data associated with updating of a state of said update object 
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transmitted from each of said plurality of information pro- 
cessing units to another of thereof, said information pro- 
cessing apparatus comprising: 

a positional information acquisition processing means for 
acquiring updated positional information associated 5 
with a position of said update object relative to said 
three-dimensional virtual reality space based on the 
update data transferred from said shared server termi- 
nal; 

evaluating means for evaluating the updated positional 10 
information and determining therefrom whether the 
position of the update object is within a particular 
portion of the three-dimensional virtual reality space; 
and 

15 

a superimposed display processing means for displaying 
the updated positional information acquired by said 
positional information acquisition processing means 
onto said three-dimensional virtual reality space image 
in a superimposed manner but only if the evaluating 2Q 
means determines that the position of the update object 
is within the particular portion of the three-dimensional 
virtual reality space. 

2. An information processing apparatus according to 
claim 1, wherein said positional information acquisition 25 
processing means acquires information associated with the 
position of said update object representing an avatar of 
another user existing in a predetermined range around the 
position of said update object representing an avatar of a 
user concerned in said three-dimensional virtual reality 3Q 
space. 

3. An information processing apparatus according to 
claim 1, wherein said positional information acquisition 
processing means acquires information associated with the 
position of said update object representing an avatar of 35 
another user existing in a sphere having a predetermined 
radius around the position of said update object representing 
an avatar of a user concerned in said three-dimensional 
virtual reality space. 

4. An information processing apparatus according to 4Q 
claim 1, wherein said superimposed display processing 
means displays the position of said update object represent- 
ing an avatar of another user onto said three-dimensional 
virtual reality space image in a superimposed manner in a 
display form based on a predetermined coordinate display 45 
system with the position of said update object representing 
an avatar of a user concerned in said three-dimensional 
virtual reality space being as an origin of said predetermined 
coordinate display system. 

5. An information processing apparatus according to 5Q 
claim 1, wherein said superimposed display processing 
means displays the position of said update object onto said 
three-dimensional virtual reality space image in a superim- 
posed manner in a display form involving a coordinate axis 
based on a predetermined coordinate display system. 5S 

6. An information processing apparatus according to 
claim 2, wherein said superimposed display processing 
means displays the position of said update object onto said 
three-dimensional virtual reality space image in a superim- 
posed manner in a display form involving a coordinate axis 6Q 
based on a predetermined coordinate system and said pre- 
determined range. 
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1, An information processing method for an information 
processing apparatus in a three-dimensional virtual reality 
space sharing system in which a plurality of information 
processing units for displaying a three-dimensional virtual 
reality space image by acquiring three-dimensional graphic 
data associated with a basic object to be commonly used by 
a plurality of users and an update object to be updated 
according to an operation performed by each of said plu- 
rality of users are interconnected with a shared server 
terminal for transferring update data associated with updat- 
ing of a state of said update object transmitted from each of 
said plurality of information processing units to another of 
thereof, said information processing method comprising the 
steps of: 

acquiring updated positional information associated with 
a position of said update object relative to said three- 
dimensional virtual reality space based on the update 
data transferred from said shared server terminal; 
evaluating the updated positional information and deter- 
mining therefrom whether the position of the update 
object is within a particular portion of the three- 
dimensional virtual reality space; and 
displaying the updated positional information acquired by 
said positional information acquisition processing 
means onto said three-dimensional virtual reality space 
image in a superimposed manner but only if the evalu- 
ating means determines that the position of the update 
object is within the particular portion of the three- 
dimensional virtual reality space. 
8. In information providing medium for providing a 
computer program to be executed by an information pro- 
cessing apparatus in a three-dimensional virtual reality space 
sharing system in which a plurality of information process- 
ing units for displaying a three-dimensional virtual reality 
space image by acquiring three-dimensional graphic data 
associated with a basic object to be commonly used by a 
plurality of users and an update object to be updated 
according to an operation performed by each of said plu- 
rality of users are interconnected with a shared server 
terminal for transferring update data associated with updat- 
ing of a state of said update object transmitted from each of 
said plurality of information processing units to another of 
thereof, said computer program comprising the steps of: 
acquiring updated positional information associated with 
a position of said update object relative to said three- 
dimensional virtual reality space based on the update 
data transferred from said shared server terminal; 
evaluating the updated positional information and deter- 
mining therefrom whether the position of the update 
object is within a particular portion of the three- 
dimensional virtual reality space; and 
displaying the updated positional information acquired by 
said positional information acquisition processing 
means onto said three-dimensional virtual reality space 
image in a superimposed manner but only if the evalu- 
ating means determines that the position of the update 
object is within the particular portion of the three- 
dimensional virtual reality space. 

***** 
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